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DETAILED ACTION 



Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1-4, 6, 8-11, 13, 15-18, and 20 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Wang et al. (US PGPub 2002/01 6571 9) in view of Nakata (US 
PGPUB 2002/0120455). 

As to claim 1 , Wang discloses a computer interface system (see 
paragraphs [0027] lines 1-6), comprising: a microphone that receives audio input 
from a user (see paragraph [0008] lines 3-5); a voice recognition mechanism 
(see paragraphs [0018]). 

Wang does not disclose specifically a user interface, wherein the user 
interface provides a form having a plurality of fields for user input, wherein upon 
selection of one field and receipt of a recognized command spoken by the user, 
the user interface displays a list of recognized input terms that appropriate for 
input into the selected field. Nakata teaches a speech recognition system for 
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such purposes as navigation that provides a user with an interface that provides 
a plurality of inputs for different categories for navigation of the speech 
recognition system. Once an input has been selected audibly by a user the 
system uses a speech guidance option and displays a list of 
recognized/accepted terms that the input filed will understand (paragraphs 
[0119]-[0121] and figures 13-16). 

It would have been obvious to one having ordinary skill in the art at the 
time the invention was made to have modified the multi-modal input system of 
Wang with the display list option as taught by Nakata. Doing so would allow for 
the user to know which terms are accepted facilitating the process. 

As to claim 8, Wang discloses a computer program product in a computer 
readable medium for use in a computer interface system (see paragraph [0027]), 
the computer program product comprising: first instructions for receiving audio 
input from a user (see paragraph [0008] lines 3-5); second instructions for 
automatic voice recognition (see paragraphs [0018]); and third instructions for 
displaying a graphical user interface that prompts the user for expected inputs 
that the user can speak at designated points in a dialog (see paragraph [0010] 
lines 3-7) according to a specified grammar (see paragraphs [0008] lines 7-9); 
wherein prompts may specify the type of expected input (drop down boxes are 
used in the GUI to indicate expected values, see figure 1); wherein prompts may 
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specify words that are recognized bye the system (see paragraph [0008] lines 7- 
9). 

Wang does not disclose specifically a first instructions for displaying a 
user interface to the user, wherein the user interface provides a form including a 
plurality of fields for user input; second instructions for receiving a selection of 
field for user input; third instructions for receiving audio input in the form of at 
least one word from a user; fourth instructions for recognizing the at least one 
word as an input term or a command; fifth instructions for causing the user 
interface to display a list of recognized input terms for inputting into the selected 
field if the inputted word is recognized as a command; and sixth instructions for 
completing the selected field with the input term if the inputted word is recognized 
as an input term. Nakata teaches a speech recognition system for such purposes 
as navigation that provides a user with an interface that provides a plurality of 
inputs for different categories for navigation of the speech recognition system. 
Once an input has been selected audibly by a user the system uses a speech 
guidance option and displays a list of recognized/accepted terms that the input 
filed will understand (paragraphs [0119]-[0121] and figures 13-16). 

It would have been obvious to one having ordinary skill in the art at the 
time the invention was made to have modified the multi-modal input system of 
Wang with the display list option as taught by Nakata. Doing so would allow for 
the user to know which terms are accepted facilitating the process. 
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As to claim 15, Wang discloses a method for interfacing between a 
computer and a human user (see abstract line 2), the method comprising the 
computer-implemented steps of: receiving audio input from the user (see 
paragraph [0008] lines 3-5); interpreting the audio input via voice recognition (see 
paragraphs [0018]); and displaying a graphical user interface that prompts the 
user for expected inputs that the user can speak at designated points in a dialog 
(see paragraph [0010] lines 3-7) according to a specified grammar (see 
paragraphs [0008] lines 7-9); wherein prompts may specify the type of expected 
input (drop down boxes are used in the GUI to indicate expected values, see 
figure 1); wherein prompts may specify words that are recognized bye the system 
(see paragraph [0008] lines 7-9). 

Wang does not disclose specifically a user interface, wherein the user 
interface provides a form having a plurality of fields for user input, wherein upon 
selection of one field and receipt of a recognized command spoken by the user, 
the user interface displays a list of recognized input terms that appropriate for 
input into the selected field. Nakata teaches a speech recognition system for 
such purposes as navigation that provides a user with an interface that provides 
a plurality of inputs for different categories for navigation of the speech 
recognition system. Once an input has been selected audibly by a user the 
system uses a speech guidance option and displays a list of 
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recognized/accepted terms that the input filed will understand (paragraphs 
[0119]-[0121] and figures 13-16). 

It would have been obvious to one having ordinary skill in the art at the 
time the invention was made to have modified the multi-modal input system of 
Wang with the display list option as taught by Nakata. Doing so would allow for 
the user to know which terms are accepted facilitating the process. 

As to claims 2, 9, and 16, Wang discloses a multi-modal input system 
wherein prompts that represent non-terminal tokens in the grammar are replaced 
with one of a set of other prompts in the grammar in response to the spoken 
input (see paragraph [0082] lines 1-7). 

Wang does not disclose specifically upon receipt of an appropriate 
recognized input term for the selected field the system automatically selects the 
next field for user input. Nakata discloses that when the user utters an input term 
the system goes directly to the next field for user input (paragraphs [01 19]-[01 21] 
and figures 13-16). 

It would have been obvious to one having ordinary skill in the art at the 
time the invention was made to have modified the multi-modal input system of 
Wang with the display list option as taught by Nakata. Doing so would allow for 
the user to know which terms are accepted facilitating the process. 



Application/Control Number: 10/676,590 
Art Unit: 2626 



Page 7 



As to claims 4, 1 1 , and 18, Wang discloses said system with at least one 
speaker that provides audio prompts for expected inputs (see paragraph [0064] 
lines 7-11). 

As to claims 6, 13, and 20, Wang discloses said system with a graphical 
user interface that further comprises a pull-down menu (see figure 1). 



3. Claims 5, 12, and 19, are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Wang etal. (US PGPub 2002/0165719) in view of Katsuranis (US PGPub 
2005/0021336). 

As to claims 5, 12, and 19, Wang does not specifically disclose a 
multi-modal input system that the prompt may further comprise a second 
graphical user interface window. Katsuranis teaches a multi-modal input 
system that displays and controls the content of a second graphical 
application window while in a first graphical application window in a 
windowed computing environment having a voice recognition engine (see 
abstract lines 1-5). It would have been obvious to one having ordinary 
skill in the art at the time the invention was made to have modified the 
multi-modal input system of Wang with the feature of the first and second 
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graphical user interface window as taught by Katsuranis. Doing so would 
have allowed a user using the system to be able to organize the graphical 
window he or she is working with and eliminate the frustration of having to 
toggle through numerous windows just to refer from one window to the 
other (see paragraphs [0004], [0005], [0033]). 



Conclusion 

A note has been made to notify the appropriate parties that the examiner has moved 
from Art Unit 2609 to 2626. 

Any inquiry concerning this communication should be directed to Josiah 
Hernandez whose telephone number is 571-270-1646. The examiner can 
normally be reached from 7:30 pm to 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, David Hudspeth can be reached on (571) 272-7843. The 
fax phone number for the organization where this application or proceeding is 
assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
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for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 



JH 



/David R Hudspeth/ 
Supervisory Patent Examiner, Art Unit 2626 



